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according to results obtained. Although this system of analyzing the 
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program accountability is not advocated* Measurement of student 
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Abrtraot 

Tbm authors advoemta tha usa of a pupU typology in ^eh tho 
Tarlmbloa of 00X9 rae«t fMdly strntusy and ranga ara eonibinad to 
f oni a wil olaaalf ieation ayatam. Thia ayatamatie arranganant of data 
idian ooiiA>lnad >flth ehanga in pu|»ll parfor&aneat allows tha eraation of 
local noraa* 

A aohama for eoinparing tha ehanga in pupil parfonumea aaipng tha 
rarioua aehoola involvad in ranadial raading and ramadial programs is 
dSBionstratad* Tha comparison of tha parformanca amonj tha rarioua 
achools InvolTsd in ramadial raading and ramadial programs is demonstratad. 
Tha cooiparlson of tha parformanca changaa in similar typas of atudenta 
la illuatratad with a raxdcing procadura according to raaulta obtained* 

Althouc^ this system of analyzing tha output of various remedial 
programs is more revealing than gross cooxparisonst sole reliance upon 
this procedure for purposaa of program accountability la not advocated* 
Meaauremant of atudent performance aa analyzed by the proposed mathodf ^ 
over a period of at least three yeara» ahould produce useful informa!-.ion 
iqpon idiich dedaions for change can be made* 



Tablt of Contents 



Pag« 

Rationale ••••• 1 

Tha Papil Typology Daaerlbad •••• •••••• 1 

Analyaia of Pupil Perf ormanoa Changaa • 2 

In a Ramedial Math Program 

Analyaia of FnpLl Perfonnanea Changaa 7 

in a Ramedial Reading Program 

Caution in the Interpretation of 11 

Eff eotiveneaa Ratioa 

Ref ereneea • Ik 

Ajypendix 1 13 

Appendix 2 .... 28 



ERJC 



(1) 



mrioiiAig 

■vftluAtinf Chang* in tht p^rfonnanet of atudanta in any rtmadial 
prograa ia not a difficult taak# Bdwarar, if ona niahaa to datamina 
tha off actiTanaaa of Tarioua ramadial prograaa within tha aama aohool 
ayatan, nains papLl parfomanca aa a BaaauM» tha taak praaanta 
aararal difficultiaa* 

Ona of tha firat problama to ba orarconay ia that of aquating tha 
prograna to ba cooiparad* Aaauming tha tiina aach program cpanda with 
atudanta ia fairly equals ona nuat datamdna if tha coopariaon ia 
among aioilar typaa of atudanta* 

It could ba aasunad that all atudanta in Titla I acboola in 
ramadial programa ara aimilarn but auch ia not tha caaa* Changaa in 
parformanca vary according to aax» raca* and X«Q« Anothar linportant 
pupil variabla in aquating groupa ia fathar &b8anca# (Saa Sutton- 
anith (1968), Billar (1971) » Sciara (1974), and Sciara (19750 

In ordar to facilitata tha ordering of data for analytical purposaa, 
a pupil typology can ba conatructad and uaad for aaay intarpratation* 

l!ha Pupil Typology Daacxlbad 
A pupil typology daaignad by tha authora and utilizad in tha 
avaluation of Titla I ramadial reading and ramadial math programa in a 
larga, midNaatam, metropolitan aehool ayatam ia ahown for purpoaea of 

illuatration* 

Pactora of aax (2), X I«Q« range (h)^ yield a 32 pupil claaai* 
fication acheme* Thia ia ahown on the next page# 
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SEX 


RACE 


FAMILT STiTDS 


B 


RAHQB 


1. 




idiite 


female head of household 


IQ 




2. 




utaite 


male head of household 




^ Ok 


?• 


Finals 


non-nhite 


female head of household 


IQ 


<o4 


4. 


Finals 


non-white 


male head of household 


IQ 




5. 


Ma1« 


^dilte 


female head of household 


IQ 




6. 


Halt 


ubite 


male head of household 


IQ 




7. 


Mal« 


non-%Aiite 


f eiaale head of household 


IQ 




8. 




non-vhlte 


male head of household 


IQ 




9. 


FtlMlO 


>diite 


female head of household 


IQ 


84-100 


10. 


F«mal« 


White 


male head of household 


IQ 


84-100 


11. 


FOTial« 


noiv-^ite 


female head of household 


IQ 


84-100 


12. 


Female 


non-%diite 


male head of household 


IQ 


84-100 


13. 


Kale 


%dxite 


female head of household 


IQ 


84-100 


14. 


Male 


idiite 


male head of household 


IQ 


84-100 


15. 


Male 


non-ipdiite 


female head of household 


IQ 


84-100 


16. 


Male 


non-«diite 


male head of household 


IQ 


84-100 


17. 


Fenale 


>ihite 


female head of household 


IQ 


101-110 


l8. 


Female 


%diite 


male head of household 


IQ 


101-110 


19. 


Female 


non-«diite 


female head of household 


IQ 


101-110 


20. 


Female 


non^-^diite 


male head of household 


IQ 


101-110 


21. 


Male 


%diite 


female head of household 


IQ 


101-110 


22. 


Male 


%riiite 


male head of household 


IQ 


101-110 


23. 


Male 


non-^Mhite 


f einale head of household 


IQ 


101-110 


2%. 


Male 


non->idiite 


male head of household 


IQ 


101-110 


25. 


Female 


>ihite 


female head of household 


IQ 


>110 


26. 


Female 


white 


male head of household 


IQ 


>110 


27. 


Female 


non-%Aiite 


female head of household 


IQ 


>110 




Female 


non^white 


male head of household 






29. 


Male 


white 


female head of household 


IQ 


>110 


30. 


Male 


White 


male head of household 


IQ 


>110 


31. 


Male 


non-4Aiite 


female head of household 


IQ 


>110 


32. 


Male 


non«>iAlte 


male head of household 


IQ 


>110 



It should be noted that the I.Q. ranges are arbitrary designations 
for ordering the data« 

Pupil absenteeism, teadher eacperienoot and conditions under lAioh 
teaohing proeedes, could be other Tariables to consider. In the study 
reportedy there were no gross differences in any of these factors # so 
they were not giTon further consideration. 



Analysis of Pupil Performance Changes 
in a Remedial Math Program 

Althoui^ the use of gain scores presents limitations » it is the 
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kind of inf oTMtlon tb«t public sdhool ptrsoimel wish to haTo roportod# 
Hm mtaeoros of tho aath tost of tho HotropolitAn Aohioronont Toot 
(MAT) in a pro-toot/ post toot pottorn noro uood in tho onalyoio of tho 
MMdiol math prosram in 1} difforont oohoolo# A total of 46? otudonto 
had eoB^loto ^uth toot oooroo nhieh could bo utilized* Thooo otudonto 
woro in grodoo kf 3$ ond 6. 

A groso aooooomont of tho otudont gain oooroo by grado and by tho 
▼ariouo nath otA>tooto io ohoun in Tablo 1. 

TABI£ 1 

OAIN SCORES* OP STDDERTS IN THE RBWEDIAL 
MATH VROSRM IN THIRTEEN 
TITX£ X SCHOOLS 



Orad* N 


CCMPOTATION 
Mean 

(rain S*D. 


CONCEPTS 
Mean 

Gain S.D. 


moBim soLviNO 

Mean 

Oaln S.D. 


TOTAL MATH 
Maan 

Gain S.D. 


* 175 

5 167 

6 121 


1.08 .88 
1.24 .97 
.61 1.13 


.77 .75 
.94 1.02 
.51 1.09 


.77 
.84 

.29 


.81 

.95 
1.01 


.91 .57 
1.03 .70 
.48 .88 


Av«rag« 


.97 


.74 


.63 




.80 



All oooroo aro otatod ao grado oquiralont oooroo* 



From Tablo 1* it io oridont that tho boot gain oooroo in ecmiputation 
aro in tho fifth grado, followod oloooly by tho fousrth grado* Tho oixth 
grado Boan gain in eonputation io approzliDatoly half of that of tho fifth 
grado* Tho oamo gonoral pattern holdo throui^out tho other oubtootOf in-^ 
eluding the total nath* 

The nain eoncentration of the remedial math program off orto haa boon 
in the ax^a of computation* Mou:i gain for remedial math otudonto in 
gradeo ^$5$ ond 6, in the area of coaqputation aToragoo almoot 10 montho* 



f 



JJLXbwifii th# aTirag^ p«rf orsMme^ gain of all tba •tudtnts Intolirtd 
In tht r«Mdiml aath prograa has batn ihownt it falls to piopoint 
atronctha or waaknaaaaa in ecoiponant aehoola in id&ieh thaaa prograaa 
oparatad# Daapar analyaia of tha taat raanlta and th^ ralatira paxw 
f orsanoa of tha Tarioua aehoola infolYad, ia poaaibla throui^ tht ' 
aa^Aoynant of tha thirtx-two pupil olaaaif ication ayatan pravioualy 
daaoribad# Tha piqpil typolog]r allowa a croaa coopariaon of tha 
output of alnilar typa atudanta among aehoola hailng pupila of tha typa 
daacribad# Biaa idiieh odi^t appaar if o^a nara to coaqpara groaa araraga 
acoraa ia Bdnlodsad* 

Utilisation of tha pupil typology ia not foolilroof • It ia 
aapaeiallr-Tulnarabla in thoaa pupil cmtagoriaa idiich ha^a only a tw 
atudanta* Daapita thaaa llmLtationat it doaa afford a coDq;>ariaon of 
raaulta of tha ramadial math program among tha varioua aehoola* 

In aToraga (or naan) aeora for aaeh eatagory in Whieh thara ia ona 
or mora pupila » ia ganaratad by tha eonqputar from aeoraa of all pupila 
in a particular eatagory from all tha ac jola in tha aanpla* In thia 
way loeal parformanoa norma ara darirad* Thaaa nomia aarra aa a uaaful 
yardatiek for eoinparing tha gain aeoraa of diff arant piqpil typaa from all 
tha aehoola ineludad in tha remedial math program* 

Mean gain aeoraa in four araaa (eonqputationt math eoneaptat problem 
aolTingy and total math) %iara plotted by grade, pupil type and indiTidual 
aehool* Theae ean be found in Appendix l* 

Trom theae data, a horisontal eocopariaon cf mean gain aeorea by 
aehool aeeording to pupil type eould be eoaiparad with the loeal gain 
norm darlTad from the aeorea of aU the pupila in that partieular 
eatagory* A tally waa then made of the ninber of tlmea aaeh aehool 
equalled or exoeedad the loeal gain norm for the piqpil typea %iho %rere 
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in tin r«Mdial mth progran. From thlst a fraetional p*rfonune« ratio 
m» com/mud, II a aehool had 11 diff araat pupil typ«a in fofurth grada 
and aqoallad or axoaadad tha loeal gain noraa a«fT«n tinaa, tlm tha 

t 

Fiiultlng fraetional ptrfomanot ratio hm 7#^« Ratios for all 
•ehoola in tha rMadial math prograa by frada and by aubtatt can ba 
found in Tabla 2« 

TAELS 2 

niACTIONAL PERFORMAtlCE RATIOS BY GRADE AND BY SCHOOL 
WHICH EQUALLED OR EXCEEDED THE LOCAL GAIN NORMS 
ACCORDING TO STUDENT TYPE IN REMEDIAL MATH 



SCHOOLS 





2 


8 


14 


22 


26 


27 


38 


41 


42 


63 


74 


87 


112 


4th arade 




























Computation 


7/11 


4/5 


6/6 


4/10 


5/6 


2/4 


V7 


3/8 


4/5 


3/5 


5/7 


5/12 


2/11 


Concepts 


6/11 


2/5 


2/6 


3/10 


6/6 


1/4 


3/7 


3/8 


1/5 


3/5 


3/7 


4/12 


7/11 


Problea 




























Solving 


10/11 


1/5 


3/6 


3/10 


2/6 


0/4 


5/7 


8/8 


2/5 


2/5 


3/7 


7/12 


3/11 


Total Math 


9/11 


2/5 


4/6 


3/10 


5/6 


1/4 


1/7 


4/8 


2/5 


3/5 


6/7 


7/12 


6/11 


5th grade 




























Computation 


5/9 


2/8 


2/4 


4/7 


2/7 


4/7 


7/9 


5/6 


3/8 


4/5 


7/9 


2/5 


7/11 


Concepts 


7/9 


5/8 


3/4 


2/7 


2/7 


2/7 


4/9 


2/6 


6/8 


4/5 


7/9 


1/5 


7/11 


Problea 


























Solving 


6/9 


3/8 


3/4 


1/7 


1/7 


3/7 


7/9 


3/6 


4/8 


3/5 


5/9 


2/5 


8/11 


Total Math 


8/9 


2/8 


2/4 


2/7 


1/7 


2/7 


8/9 


4/6 


4/8 


4/5 


5/9 


2/5 


8/11 


6th arade 




























coaputation 


5/6 


4/6 


3/5 


0/5 


2/6 


4/8 


3/7 


1/2 


1/5 


5/5 


6/8 


2/2 


3/10 


Concepts 


6/6 


3/6 


4/5 


1/5 


3/6 


2/8 


3/7 


1/2 


2/5 


4/5 


6/8 


1/2 


3/10 


Problem 




























Solving 


4/6 


5/6 


3/5 


3/5 


4/6 


3/8 


4/7 


1/2 


2/5 


4/5 


7/8 


0/2 


1/10 


Total Math 


5/6 


3/6 


3/S 


0/5 


4/6 


3/8 


3/7 


1/2 


1/5 


5/5 


7/8 


2/2 


2/10 



Fractional ratioa vara conrartad to parcantagaa to naka tha data 
■ora wDXtebla* A naan parcantaga fron all of tha gain acoraa by grada 
In aaeh aubtaat waa ccaputad* Tha avaraga for all achoola aarvad aa a 
atandard againat nhich tha othar acoraa could ba conqparad* Tha nuBibar 
of tinaa a aehool aquallad or axcaadad tha local gain norm (or araraga 
of all tha achoola) ia countad and writtan in fractional form Which ia 
ttian aonrartad to a parcantaga# Thia ps^ocaaa ia ahoun in Tabla 3« 



(6) 



YABLB 3 

9BRCENTAGE OF MEAN SCORES BY WHICH SCHOOLS 
SQUALLED OR EXCEEDED THE LOCAL GAIN 
NORMS IN REMEDIAL MATH 



SCHOOLS 





All 


4 


o 


14 


22 


2o 




Jo 


41 


42 




74 


o7 


112 


4th arade 








* 












* 










^AMntl^A^4 Aft 




63* 


80* 


inn 




83* 






37 


fin 


60* 


71* 


41 


1 a 


Concepts 


44 


54* 


40 


33 


30 


100* 


25 


42 


37 


20 


60* 


42 


33 


63* 


froblra 




* 












* 










* 




Solving 


46 




20 


50* 


30 


33 


0 


71 


100* 


40 






58 


2\ 


Total Math 


52 


81 


40 


66 


30 


83^ 


25 


14 


50 


40 


60* 


85* 


58* 


54 


5th arade 






























Computation 


56 




25 




57* 


28 


57* 


77* 


83* 


37 


80* 


77* 


40 


63* 


Concapts 


53 




62* 


75* 


28 


28 


28 


44 


33 


75* 


80* 


77* 


20 


63* 


froblan 






























Solving 


52 


««: 


37 


75* 


28 


28 


42 


77* 




50 


60* 


55* 


40 


72* 


Total Math 


52 


88* 


25 


50 


28 


14 


28 


88* 


66* 


50 


80* 


55* 


40 


72* 


6 th arade 






























Computation 


52 


83* 


66* 


60* 


0 


33 


50 


42 


50 


20 


100* 




100* 


30 


Concepts 


53 


100 


50 


80* 


20 


50 


25 


42 


50 


40 


80* 


75* 


50 


30 


Problem 






























Solving 


48 


66* 


83* 


60* 


60* 


66* 


37 


57* 


50 


40 


80* 


87* 


0 


10 


Total Math 


55 


83* 


50 


60* 


0 


66* 


37 


42 


50 


20 


100* 


87* 


100* 


20 


Frequency 




11/12 


4/12 


9/12 


2/12 


5/12 


i/12 


5/12 


3/12 


2/12. 11/12 


10/12 4/12 


6/12 


Percentage 




91* 


33* 


74% 


16« 


41« 


8% 


4iy 


25« 


16* 


91« 


83« 


33« 


50« 



Equalled or exceeded local gain norm. 



Ttomnm p^remtages b«oom nom meaninsful plM«d in rank 
ord«r# This i0 shown in Tabls k. 

TABZ2 4 

Z9VECTIVENESS PERCENTAQES BY RANK ORDER 
REMEDIAL MATH PROGRAM 



School 


Parcdntaga 


Ranlq 


2 and 63 




1 


7* 




2 


\k 




3 


112 




1^ 


26 and 38 


^1% 


5 


8 and 87 


V13^ 


6 


k\ 


255< 


7 


22 and 1^2 


1^J< 


8 


27 




9 


Maan ^ 
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ThiB grtattrt laina In th« r«mdial math progran by pwqpil typas and 
vtlUsinc tha loeal sain norma crvatad by data from all tha aehoola, ara 
at Sdhoola #2 and #63* Tha laaat aff aotiva pupil outoonaa (gain aeoraa) 
in tha ramadial math program vara at Sohool #27* 



Analyaia of Pupil Farf ormanoa Changaa 
in a Remadial Raading Program 

Ramadial raading programs vara hald in fourtaan diffarant aehoola* 

Tha eomplata taat aeoraa from 603 ehildran vara availabla for avaluation« 

Thaaa taat aeoraa vera tha raaulta of tha eooipariaon of pra^taat/poat 

taat raaiata of tha raading taat of tha Matropolitan Aohiaramant Taat* 

In tha raport furnished by tha Title I reading auparvisor, gains 
nera made on the basis 0/ 1 month gain on the aehierement test for 
each month of instruction in the remedial reading program for 3*^3 (or 
37%) of the 603 total children served* A conqplete listing of the numbers 
in each grade meeting this criteria is given in Table 3« 



TABLE 5 

A BREAKDOWN OF THE STDDENTS VRO 
OAINED A .1 GAIN FOR EACH MQMrR 
OP INSTRnCTIOK Tft THE 
REMEDIAL READING PROGRAN 







Stcutonts Showing 




Total 


Qrad* 


•1 Gain p«r Month 


Percent 


Students 


2 


27 




42 




86 


67% 


128 


I 


61 


iVt 


118 


5 


107 


5Q5< 


Zlk 


6 


62 


61% 


101 


Totals 






603 



u 
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It apKMan that th« gr^atm&t gfdxm vtn madt at tht third sradt 

Airtragt gains by grade and by raading aubtaata nara ealtnalatad 
and can ba found in Tabla 6« 

TUBIE 6 

MEAN GAINS IN REMEDIAL READINO STDDENTS 
ACCORDING lO GRADE AND READING SUBSCQRES 







Word 




Total 


Orad* 




Reading 


Reading 


2 


1.02 


.74 


.90 


3 


.92 


.89 


.90 




.72 


.70 


.71 




.68 


.96 


.81 


1 


.80 


1.09 


.95 



All aeoraa ara atatad aa grada aquiralant aeoraa. 



Fron thia tabla it ean ba aaan that tha graataat araraga gains in 
word knoHladga wars in tha second grada. Tha graataat araraga gains in 
tha reading aubteat were in grade aix« <h*ade aix also recorded the 
greateat average total acore gaint closely followed by gradea two and 
three. 

Following the identical procedure mentioned in remedial math, the 
niiBber of timea each achool equalled or exceeded the local gain norm 
in a pupil claaaification, a fractior^I performance ratio waa cooputed* 
The plotted gain acorea by grade, pupil type, and indiTidual achoolf aa 
well aa the araraga for all achoola, can be found in Appendix 2« 
Fractional performance ratioa can ba found in Table ?• 
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TABLE f 

FRACTIONAL PERFORMANCE RATIOS BY GRADE AND BY SCHOOL 
WHICH EQUALLED OR EXCEEDED THE LOCAL NORMS 
ACCORDING TO STUDENT TYPE IN REMEDIAL READING 



SCHOOLS 

14 22 27 41 42 45 47 63 74 87 112 114 



grade 2 

R 1 nn^^"^^^^^ GRADE TWO SCORES WERE COLLECTED, BUT 

Total INSUFFICIENT NUMBER FOR ANALYSIS 

grade 3 

Word Knowledge 5/7 5/8 1/1 0/2 1/4 9/11 1/5 g 4/5 g 6/8 2/6 4/9 

Reading 2/7 7/8 1/1 w 1/2 0/4 7/11 2/5 gw 3/5 OW g/a 4/6 6/9 

Total 4/7 4/8 1/1 g 1/2 1/4 10/11 1/5 D 3/5 5 5/8 2/6 4/9 

grade 4 g w w 

Word Knowledge 7/7 1/8 6/9 H 2/5 4/7 

Reading 3/7 5/8 5/9 ^ 3/5 6/7 

Total 7/7 4/8 6/9 g 1/5 6/7 ^ 

grade 5 § 

^ _ . _ pj 

Q 
D 
E-» 
W 

O 

2S 



Word Knowledge 


7/9 2/15 


7/8 


3/12 


3/8 


5/6 


Reading 


8/9 4/15 


6/8 


4/12 


3/8 


5/6 


Total 


9/9 3/15 


7/8 


3/12 


3/8 


5/6 
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grade 6 


.^.^ 
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Word Knowledge 
Reading 
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25 Q 25 a 


3/4 
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0 u 
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2! Q 
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Total 


en en 


2/4 


5/8 


cn 


cn 



2/5 
2/5 
1/5 


7/7 
3/7 
4/7 


0/3 
1/3 
1/3 


4/11 
5/11 
5/11 


•4/6 
4/6 
4/6 


6/12 
6/12 
4/12 


0/3 
1/3 
0/3 


2/7 
1/7 
1/7 


9/13 
9/13 
10/13 


3/5 
1/5 
1/5 


6/7 
2/7 
4/7 


3/4 
3/4 
3/4 
cn 


4/9 
5/9 
4/9 
w 


4/ 5 
4/5 
3/5 


4/8 
4/8 
4/8 


11/11 
8/11 
10/11 


3/7 
3/7 
2/7 


1/7 
2/7 
1/7 
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0 u 

2: Q 
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e» 
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0 u 
2: a 
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cn 


5/8 
5/8 
4/8 



Thm same fractional ratios were changed to percentages* A mean 
peroeatage for all the schools was f igumd in each subtest by grade* 
Comparison of the percentages which equalled or exceeded the mean per-- 
oentAge for all the schools enables one to derire a fractional ratio* 
Tbm fraotional ratio is then conrerted to percentage figure* This can 
be found in Table 8* 
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TABLE 8 

PERCENTAGE OF MEAN SCORES BY WHICH SCHOOLS EQUALLED 
OR EXCEEDED THE LOCAL GAIN NORMS IN 
REMEDIAL READING 



All 



14 



22 



27 



SCHOOLS 
41 42 45 



47 



63 74 87 112 114 



grade 2 

Word Knowledge 

Reading 

Total 

grade 3 

Word Knowledge 

Reading 

Total 

grade 4 

Word Knowledge 

Reading 

Total 

grade 5 

Word Knowledge 

Reading 

Total 

grade 6 

Word Knowledge 

Reading 

Total 

Frequency 

Percentage 



GRADE TWO SCORES WERE COLLECTED, BUT 
INSUFFICIENT NUMBER FOR ANALYSIS 
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28 
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90 


20 


14 
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9/9 3/9 6/12 



1/6 1/9 6/9 3/3 0/12 7/9 4/12 2/9 
16% 11% 66% 100% 0% 11% 33* 22% 100% 33* 50* 



Equalled or exceeded local gain norm. 



From the i>eroantase89 a rank ordering can ba made idileh allows 
cooparative interpretation^ This is seen in Table 9* 
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TiBI£ 9 

BffiBCnVENESS FERCElirAOES Bt RANK OBJSER 
REMEDIAL READINO PROGRAM 



School 


Pereantaga 


Rank 


87 and 42 


1009K 


1 


Ik 




2 


47 and 2 


77^ 




kl 


66j^ 


? 


Ilk 


5Q5< 


5 


k 




6 


63 and 112 




7 


7k 


22^ 


8 


22 




9 


27 




10 


k5 




11 


Mean 31^ 







Ranking remedial reading programs in the various schools according 
to effectiveness percentages allows ooxnparison and interpretation of 
restCLts* In terms of program gains^ schools #87 and #42 show the hif^est 
relative gains >dien compared to the efforts of the other Title I schools 
in idiich the remedial reading programs were held* The school showing 
the least relative gain* usijig the same ocHopitz^ison is School #43« 



Caution in the Interpretation of 
Effectiveness Ratios 

Absolute inferences from the effectiveness ratios in the remedial 
math and remedial reading programs should be avoided* This caution is 
necessary because of the low nunibers of students in certain pupil 
categories brings a weakness to this procedure* 

The authors would not like to leave the impression that the 
effectiveness comparisons are of little value* A careful use of them 
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is T^oammOMd. If trends idiioh $t% appartnt on% ytary eontiimt 
for anothtr yaar or two, thm a strongor position of intorprotation 
eoold bo Justified* 

Schools i^oh rank at tho top or tho bottom of tho off ootiToness 
ranco should bo earofully serutiniaod* Vhy do soma schools rank hi|^ 
and others low? Arc thoro factors of teaching materials » teaching 
appiroachy teacher skilly parental wpportf or ethers idiich could account 
for these differences? 

One must realize that the tise cf a raxiking procedure and that of 
mean scores will, by its nature 9 distribute the schools in different 
positions* Some of the schools will be at the top and some at the 
bottom* The critical factor is how close or far away a particular 
school is to the mean or average* If one school raxiks at the top with 
a rating of lOQ^ and another school raxdcs at the bottom with IQ^t and 
the mean percentage effectiveness of all schools is SQ^t then it is 
obvious thaty relatively . one school has done very well and the other 
has done poorly* A school with an effective percentage of 44^ is below 
the meany but not so far as to cause some concern* Interpreted fairly, 
it is felt that the effectiveness ratios can be of benefit* 

Althougn this was not donsy the effects of a remedial program upon 
students placed into various pupil categories may serve as further 
insist at the various schools* A school ^ch demonstrates greater 
gains for certain types of pupils 9 and significantly lower ones for 
other pupil types, needs to re-examine their materials and teaching 
methods* 

Utilization of a piqiil typology to evaluate change in student per- 
formance throu|[h programs, allows a fair cooparison of results among the 
various schools or teachers employed in such programs* Althoui^ other 

ERIC 
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f aotert auat b« eonaidtnd, a sttp elottr to t«aolMr aeeountablllty 
appears to b« poaalblo throu^ tho uao of a pupil elaaalf loatlon ayataa 
eo(9lad with parfomanca ohaneaa, intarpratad ttaroui^ tha uaa of local 
oonaa* 
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APPENDIX 1 

REMEa)IAL MATH GAIN SCORES FOR GRADES 3t and 6 
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